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Abstract. One of the actual problems in the field of numerical optimisation, as is well known, is the problem of the 
search for the global extremum of a multivariate function [1-9,13,14,17-21]. Various versions of the random search methods 
[6,8,9] are considered to be the most reliable to solve the problem of global optimisation. In this work we present the 
little-known methods of Halton and LP-search, which has been proved as one of the best practical solutions of the global 
optimisation problem. 
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1. Introduction. It is known [1 - 6, 13, 14, 21], that many problems in tlie engineering practice are 
related to the search for the best solution in the set of all allowable, and can be reduced to a problem of 
nonlinear programming: 

to find min f(.T), x G i?" 

given the restrictions in form of equalities and inequalities defining the so-called area of allowable solutions 
G: 

r hfe(x) = 0, A: = 1,2, . . . ,m, 

\ gfe(S) < 0, fc = TO 1, m -I- 2, . . . ,p. 

Objective function f(a;)= f(xi,X2,. . . ,a;„) defines the objective for choosing the best solution from a 
set of alternatives. (One can speak of minimization, since maximization of f(a;) is obviously equivalent to 
minimization of function (- f(a;))). Any vector x, satisfying the restrictions, is called an allowable vector 
or an allowable point. 

The allowable vector x* = (x*, Xj, . . . , x*), which imposes the minimum of the objective function 
f(a;), is called the optimal point, and the appropriate value of function f(a;*) - the optimal value of the 
objective function. The pair x* and f(x*) is the optimal solution. A distinction is made between local and 
global optimum solutions. In both cases f(a;*) < f(a;), but for the global optimal solution this condition 
is satisfied for all x eG, while for the local optimal solution the condition is satisfied only for a small 
vicinity of a point x* . 

The global minimum is the optimal solution for the whole set of allowable solutions. It is better than 
the other solutions corresponding to local minima, and, as a rule, it is the one that is required to be 
found. However, all known and effectively working numerical methods of optimisation solving the above- 
mentioned problem of nonlinear programming are local, i.e. determining only locally optimal solutions 
[1-9]. This fact proves to be true by the numerical experiments that have been carried out (including 
the algorithms used in the mathematical packages MATLAB 6 and JVIAPLE 6). 

2. Halton &: LP - search methods. The methods of Halton and LP-search are the deterministic 
analogues of the global random search. It is known, that the elementary global search of a point of 
the minimum x* of the objective function f {x) is performed as follows: in the allowable area G some 
trial points chosen, at each one the value of the objective function is calculated, and 
the point is selected at which the objective function attains the smallest value. This point serves as 
the first approximation of the required point x* of the global minimum of the objective function i{x). 
It is considered, that the search method converges, if at least one of the points x^, x^, . . . , x^given a 
big enough N, will fall into some predefined small vicinity U of the point of the global minimum of the 
objective function f(x). 

Let the allowable area G to have a form of a singular n-dimensional cube K" ={0< xj <1, j = 
1,2,3,. . . ,n}. As the trial points x^, x^, . . . , X''^ for a random search we shall choose the independent 
random points evenly distributed in K". The probability that at least one point will fall in a small 
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Fig. 2.1. "Evenly grid" for n=2 (N=25) 



Fig. 2.2. Improved grid for n=2 (N=25) 



vicinity of a point of minimum U, equals P=l-(1-U)^ and approaches 1 when N — > oo, i.e. the 

method converges. 

For a non-random search non-random points chosen as the trial points. At the 

first glance it seems, that points should be chosen in regular intervals on area K" (Fig. 1). However it is 
not so [13, 14]. Suppose, that function f{x) depends only on one argument f(a;) = f(a::i). 

Calculating its values at points of such a "evently grid" consisting of N = M" points (Fig. 1), we 
obtain M various values among which we shall choose the smallest, i.e. N - M points were calculated to 
no purpose. So, for example, for the case of a function of two variables f(.Ti,.T2), defined in K^, which 
strongly depends only on Xi , we shall obtain only five various values, each of which is repeated five times 
(Fig. 1). If f(a;) "essentially" depends on m < n arguments, N - of m points will be considered 
vainly. So, for example, if n = 4, m = 2 and M = 10 the number of "superfluous" values of function will 
be equal to N - M'" = - = lO'^ - 10^ = 9900 while the number of calculated values N = 10000! 
For the first time such feature was mentioned in 1957 in [10]. 

Random grids are devoid of the indicated flaw, for the probability of occurrence of identical abscissa 

at several random points is equal to zero. But can it be "good" to pick and choose the trial points, instead 
of relying on the will of a chance in choosing them? For example, if n = 2, points, represented in Fig. 
2, are projected onto each of the coordinate axes to N various points, and, calculating the values of the 
function at the points of such a grid, we shall acquire N various values giving a much better representation 
of the function and of the range of its variation. 

The idea of Halton's and LP-search methods is to use as trial points the points from the evenly dis- 
tributed sequence of points in K'^ [11,14-16], namely: Halton's sequence Pi, P2,. . . , Pn,- ■ ■ , constructed 
in [15, 16] and LP^- -sequence Qi,Q2,- ■ ■ ,Qn, ■ ■ ■ , constructed in works of I.M.Sobol [11]. The Halton 
and LP.r-sequences are the deterministic analogues of a sequence of independent random points evenly 
distributed in K". Global search over the points of these sequences converges: it has been proved, that 
if Sjv(U) - is the number of the points which have fallen into a small vicinity U of the point of the 
minimum of the objective function f (x), then S^r (U) > 1 is satisfied, given a big enough N. The more 
evenly the points are distributed, the faster the search converges. It is considered, that the points of 
the LPi-sequence are the most evenly distributed compared to all other known sequences [11]. (At the 
same time, test calculations, the results of which are presented below, have not shown any substantial 
advantage of the points of the LPi-sequence over the Halton's sequence points). 
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2.1. Halton's Sequence. If ri, r2, . . . , r„- are pairs of coprimes, then Halton's sequence is defined 
as the sequence of points {P^} in K" with Cartesian coordinates Pj = (Pri( i ), Pr2( i )> • • • ' Pr„{ i ))) i 
= 1, 2, . . . , where Pr{ i ) is the numerical sequence determined as follows. 

If am&m-i- ■ ■ a2ai is an integer i written in base r, then pr(«) = 0.aia2 . . . am-io-m (here all the as 
are whole "r" numbers, i.e. are equal to one of the values 0, 1, . . . , r - 1). Accordingly, in the decimal 
system we have 

m m 
s=l s=l 

For example, the first 10 values P2{i), P3{i), P5{i), P7{i), Pn{i) are equal: 
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All such sequences are evenly distributed in K". In practice, as a rule, the first n prime numbers are 
chosen as ri, r2, . . . , r„; ri= 2, r2 = 3, ra = 5, . . . also used are n-dimensional points Pj = ( P2( i ), P3( 
i ), ...,Pr„( i )), i = 1,2,3,... 
For example: 

1. at n = 2, wc obtain Halton's sequence as following: 

Pi = (1/2, 1/3), P2 = (1/4, 2/3), Pa = (3/4, 1/9), . . . , Pio = (5/16, 10/27), . . . ; 

2. at n = 3, we obtain: 

Pi = (1/2, 1/3, 1/5), P2 = (1/4, 2/3, 2/5), . . . , Pio = (5/16, 10/27, 2/25), . . . ; 

3. at n = 4, wc obtain: 

Pi = (1/2, 1/3, 1/5, 1/7), P2 = (1/4, 2/3, 2/5, 2/7), . . . , Pio = (5/16,10/27,2/25,22/49), . . . 

2.2. LPr -sequence . If in the binary system the index of a point is entered as: i = em<Sm-i - ■ ■ e2ei, 
where 61^62, . . . , e™ - are binary numbers, each equal to or 1, then the corresponding decomposition of 
the index of a point in the decimal numeration system has the following form: i = 2'^~^em+ 2'"~^em_i+ 
. . . + 2e2 + ei), for all 1 < j < n 

q} = eiV/ * 62^/ * egF/ * ... * e„y™, 

where qj, j = 1,2,. . . ,n - are coordinates of points Qj of LP^ - sequence. 
Vectors = {Vf , , ■ ■ ■ , ) are easily calculated. 

In work [11] a table of numerators of the point coordinates of for 1< n < 13, 1< s < 20 is 
presented, referred to as directing points. Denominators of all coordinates of a point V'^ equal 2*. For 
example, at n = 7, s = 3 we have V^= (1/8, 5/8, 7/8,1/8, 5/8,7/8,3/8). Thus, the number of points 
N < 2^^, dimension n < 13. In work [14] a table of directing points for 1< n < 51, 1 < s < 20 is presented. 
Unfortunately, there are no simple-enough formulas for calculation of directing points for any n and s. 

Operation * means digit-by-digit addition by the module 2 in the binary system: 

; I I 

if a = ^^afe2~*'; 6 = ^6^2"'^; than a * 6 = Cfe2~*^, where cj, = (afe + 6fe)mod2. 

k=l fe=l k=l 

(In more detail: to calculate the "sum" a * b, it is necessary to write down both these numbers in binary 
notation and to combine digits in the appropriate places by rules: 0-1-0 = 0, 1-1-0 = 0-1-1 = 1, 1-1-1 
= 0, i.e. without carrying units to the higher digit places. For example: | * = 0.111* 0.1011 = 
0.0101 = ^). 
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In all computers there is a special command for carrying out the operation *. The number of 
operations performed by a computer for the calculation of Qj increases with the increasing i, but slowly, 
as log2i. 

For example, we have to calculate points Q13 and Q22 in a 4-dimensional cube. 
Since in binary notation decimal number 13 is represented as 1101, then ei = 1, e2 = 0, es = 1, e4 
= 1 and coordinates of Q13 equal: q]'^ — * * i 1 < j < 4 

Vectors , , V'^ could be obtained with the help of the table: 

l/l —(III iV V3 — (I 5 7 iV 1/4 _ /-J_ 15 11 _5_\ 

V2'2'2'2''''^ vg'S'S's/' vie'ie'ie'ie/" 
For the coordinates in the binary system, we have 

qP = 0.1 * 0.001 * 0.0001 = 0.1011 = ji; q^^ = 0.1 * 0.101 * 0.1111 = 0.1101 = i| ; 

qi3 = 0.1 * 0.111 * 0.1011 = 0.1101 = i|; qi3 = 0.1 ^ 0.001 ^ 0.0101 = 0.1111 = if. 

So, Qi3 = (11/16, 13/16, 13/16, 15/16). 

Similarly, since in the binary system the number 22 can be written down as 10110, then Q22 = 

* , and the coordinates of Q22 equal: 

qf ^ 1/4*1/8*1/32 =0.01*0.001*6.00001 = 0.01101 = 13/32, 

q22 ^ 3/4*5/8*17/32 = 0.11*0.101*0.10001 = 0.11101 = 29/32, 

q22 = 1/4*7/8*13/32 ^ 0.01*0.111*0.01101 = 0.11001 = 25/32, 

q22 = 3/4*1/8*31/32 = 0.11*0.001*0.11111 = 0.00011 = 3/32. 
Thus, Q22 = (13/32, 29/32, 25/32, 3/32). 

Using points Qi, it is possible to obtain the appropriate trial points = {x\ , x\ , . . . ,x\^ ) in any 
parallelepiped 11: a j < Xj < bj , I < j < n. Their coordinates can be calculated by the formula 

Xj = ttj + q]{bj — Uj), 1 < j < n. 

It has been proved in [14], that if points Qi= ( q^^, q|, . . . , q^ ) form an evenly distributed sequence 
in K", then points a;* = {x\, Xj,..., xU also form an evenly distributed sequence in n-dimensional 
parallelepiped 11. Also it has been proved, that if x^, x"^, x^, ...is a sequence of points evenly 
distributed in a given parallelepiped 11 with the sides parallel to the coordinate axes, and G C 11 - is 
some area with the positive volume Vq > 0, then all selected points G G , also form a sequence of 
points evenly distributed in G. The ratio of volumes 7 = Vc/Vn is called the efficiency of selection, as, 
on the average, to obtain one point in G it is necessary to consider I/7 points in 11. 

Naturally there is a question: why are these " quasi-random numbers" better than the random num- 
bers in the Monte Carlo method [10,12]? 

1. On all the classes of test functions f{x) on which numerical experiment was carried out, Halton 
and LP-search methods allowed to attain the same accuracy as the random search, but with the 
number of trial points being 2-4 times less, and with faster convergence. 

2. Calculation of points of Halton and LP^ - sequences is rather simple and can be easily pro- 
grammed. 

3. Test problems and estimation of efficiency of Halton and LP-search methods. In 

practice the estimation of efficiency of numerical methods of optimisation is usually performed through 
computing experiments aimed at solving the so-called special test problems [2, 3]. One of the major 
questions here is the question on how widely can the method be used, i.e. whether it is possible to solve 
the majority of problems with the help of a given method? 
Methods were checked using the following test functions: 

1. "Rozenbrock's Function" : 

f{xuX2) = 100(X2 - Xj)^ + (1 - Xi)2 

— unimodal function of a "gully" type with nonlinear "bottom" of a parabolic kind (has an 
abrupt rounded hollow along a curve X2=xl). The minimum of the function is reached at the 
point X* = (1,1) and f{x*) = 0. 

2. "Fletcher-Powell's Function": 



f{xuX2,X3) = 100{[a;3 - 5e{xi, X2)f + [{xl + xjY^^ - l]^} + xj, 
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where 



6{xi,X2) = < 



1 X2 

— arctg( — ), if > 0, 

TT Xi 

1 X2 

1 H — arctg( — ), if xi < 0, 

TT Xl 



- function with a "coiling ravine" . Its partial derivatives of the 1st order are piecewise continuous. 
The global minimum is reached at the point x* = (1,0,0) f (x*) = 0. 
3. "Powell's Function": 



f{xi,X2,X3,X4) = (xi + 10X2)'^ + 5(X3 - Xi)"^ + {X2 - 2X3)^ + lG(.Ti - .T4)'* 

- function has a "flat gully" bottom (weak singularity). The minimum is reached at the point x* 
= (0,0,0,0) and { (x*) = 0. The Hessian of the function is singular at the point x*. 
4. "Wood's Function": 



f{Xi,X2,X3,X4) = 100(x2-a;?)2 + (l-xi)2 + 90(x4-x§)2 + (l-;c3)2 + 10.1((x2-l)' + (x4-l)') + 

+ 19.8(X2- 1)(X4- 1) 

- function has some local minima, distinct from the global one. The global minimum is achieved 
at the point x* = (1,1,1,1) and f (x*) = 0. 

5. 

f{x\,X2) = x\+x% — cos(18a;i) — cos(18a;2) 

- the function has 25 local minima on [— tt, tt]. The global minimum is achieved at a point x* = 

(0,0) and its value is equal to f{x*) = -2. 
6. "Himmelblau's Function" : (10 variables) 

10 10 

fix) = - 2))' + (ln(10 - Xi)f) - (H Xif-' 

i=l i=l 

with boundary conditions 2.001< Xj < 9.999, i = l,2, ...,10 (outside of allowable area objective 
function is undefined). The minimum is achieved at the point x* = (9.351; 9.351; 9.351; 9.351; 
9.351; 9.351; 9.351; 9.351; 9.351; 9.351) and f{x*)= - 45.778. 

7. 



/(a;i, a;2) = f 25(1 + xi) + 0.5- 



0.133 • 107 + 40931.68xf + 999.44xf - 32613.30x^ + 12543.58xix^ - 122795.04xi 

where 0.1 < xi < 5; 0.1 < X2 < 10- objective function from the practice of design of automated 
drives for flying devices (V.A. Polkovnikov Electric, Hydraulic and Pneumatic drives for flying 
devices and the range of their dynamic capabilities. M.: Publ. MAI, 2002). 
Any optimisation procedure should solve the specified problems effectively. 

The choice of both multimodal, and unimodal test functions is not accidental. It is necessary to be 
convinced of efficiency of the considered methods of global optimisation not only for the search of global 
minima of multimodal functions, but also for the search of minima of unimodal functions of complex 
geometry, by which all known gradient methods are tested (deciding the question of "how widely the 
methods can be applied"). 
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Below wc present the results of calculations for the programme implementing Halton's and LP-search 
methods providing an opportunity to specify the solution, i.e. to find a point of the global minimum with 
any predefined accuracy. Used as a method of specification is one of the best quasi-Newton methods - the 
method of Davidon-Fletcher-Powell (DFP) with the most widely adopted stopping criterion for smooth 
problems of the type ||grad/(.x*)|| < e. 

Authors of the programme (in programming language C++) are EugeneV. Antonij and Dmitri B. 
Poljakov. 

Results of calculations for the appropriate test functions are presented in Tables 3.1 - 3.7. 
"Rozenbrock's Function". ( -2 < < 2, -2 < X2 < 2 ) : 



Table 3.1 
Rozenbrock's Function 



Number 
of points N 


LP-search 
Method 


LP-search Method 
with specification 

(e=10-6) 


Halton's Method 


Halton's Method 
with specification 

(e=10-6) 


2000 


f(x*)=0.0062603 
xl = 1.0078125 
xl ^ 1.0078125 


f(.x*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 


f(r)=0.0034812 
xl = 1.0214844 
xl = 1.0489255 


f(.T*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 


8192 


f(x*)=0.0043641 
xl = 0.9638672 
xl = 0.9345703 


f(:E*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 


f(x*)=0. 0004207 
xl = 0.9980469 
xl = 0.9940558 


f(x*)=0. 0000000 
xl = 0.9999994 
xl = 0.9999988 


32767 


f(x*)=0.0012168 
x\ =0.9713135 
xl = 0.9454346 


f(x*)=0.0000000 
xl = 1.0000000 
xl = 1.0000001 


f(x*)=0.0004207 
xl = 0.9980469 
xl = 0.9940558 


f(x*)=0.0000000 
xl = 0.9999994 
xl = 0.9999988 


65535 


f(x*)=0.0000036 
xl = 0.9999390 
xl = 1.0000610 


f(x*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 


f(x*)=0.0003650 
xl = 1.0169067 
xl = 1.0332097 


f(x*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 



Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 

following results: 

given x° = (-5;-5): x* = (1.0000000; 1.0000000); f(x*) = 5.6304 • 10"!°; 
given x° = (5; 5): x* = (1.0000000; 1.0000000); f(r ) = 5.6197 • 10-^°; 
given xO = (-5; 5): x* = (1.0000000; 1.0000000); f(5*) = 8.8830 • 10-^°. 
The result is satisfactory. 

"Fletcher-Powell Function". (-1< xi < 1, 0< X2 < 2, 0< X3 < 2): 

Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 
following results: 

given x° = (-10; -10; -10): x* = (1.0000; 0.0000; 0.0000); f(5*)=7.0274 • lO'^; 
given x" = (-0.001; 10; 10): x* = (-0.0017; -0.9998; 7.4231); f(.T*)=55.6538. 

One can conclude, that in the MATLAB 6 system the problem cannot be solved, as there is de- 
pendence of the results on the initial conditions of the search (which is typical for the local methods of 
optimisation, or in the case of discontinuity of partial derivatives of objective function for some variables). 

"Powell's Function". (-1 < Xi < 2, i = 1,2,3,4): 

Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 

following results: 

1) given x° = (-5;-5;-5;-5): x* = (0.0002799; 0.0000280; -0.0000742; -0.0000743); 
f(x*) = 5.0413 • 10-"; 

2) given x" = (-5; 5;-5; 5): x* = (-0.0001917; 0.0000192; 0.0006634; 0.0006633); 
f(r) = 8.3379 • 10-12. 

The result is satisfactory. 

"Wood's Function". (0 < a;^ < 3, i = 1,2,3,4): 

Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 
following results: 

given x° = (-5; 4; -3; 2): x* = (-0.2067; 0.0397; 1.4070; 1.9820); f(5*)=2.0051; 
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Table 3.2 
Fletcher- Powell Function 



Number of 
points N 


LP-search 
Method 


LP-search Method 
with specification 

(£ = 10-^') 


Halton's 
Method 


Halton's Method 
with specification 

(e=10-«) 


2000 


f(x*)=0.2782941 
xl = 0.9521484 
X* = 0.0410156 
x*3 = 0.0449219 


f(x*)=0.0000000 
xl = 1.0000000 

x* = 0.0000000 
x*3 = 0.0000000 


f(x*)=0.5961633 
xl = 0.9389648 
x*2 = 0.3063557 
xl = 0.4396800 


f(x*)=0.0000000 
xl = 1.0000000 
x^ = 0.0000000 
xl = 0.0000000 


8192 


f(x*)=0.1721926 
xl = 0.9700928 
X* = 0.2556152 
xl = 0.3991699 


f(x*)=0.0000000 
xl = 1.0000000 
X* = 0.0000000 
x^ = 0.0000000 


f(x*)=0.3818622 
xl = 0.9422607 
x^ = 0.3713865 
xl = 0.6024960 


f(x*)=0.0000000 
xl = 1.0000000 
x^ = 0.0000000 
xl = 0.0000000 


32767 


f(.T*)=0.0970329 
xl = 0.9846497 
x^ =0.1121216 

X* = 0.1549683 


f(.x*)=0.0000000 
xl = 1.0000000 
= 0.0000001 
xl = 0.0000002 


f(x*)=0.0973852 
xl = 0.9801636 
a;| = 0.0120917 
a;^ = 0.0433920 


f(x*)=0.0000000 
xl = 1.0000000 
x| = 0.0000000 
xl = 0.0000001 


65535 


f(i*)=0.0867985 
xl = 0.9713898 
x^ = 0.0281677 
= 0.0528259 


f(x*)=0.0000000 
xl = 1.0000000 
X* = 0.0000000 
xl = 0.0000000 


f(x*)=0.0883128 
xl = 0.9718781 
x^ = 0.0985283 
xl = 0.1496832 


f(x*)=0.0000000 
xl = 1.0000000 
x*2 = 0.0000000 
xl = 0.0000000 



Table 3.3 
Powell's Function 



Number of 
points N 


LP-search 
Method 


LP-search Method 
with specification 

(£ = 10-«) 


Halton's 
Method 


Halton's Method 
with specification 

(£=10-6) 


2000 


f(x*)=0.6550502 
xl =-0.7890625 
xl = 0.0546875 
xl = -0.3671875 
xl =-0.4140625 


f(x*)=0.0000000 
xl = -0.0001419 
xl = 0.0000142 
xl = -0.0001390 
xl = -0.0001389 


f(x*)=0.7399679 
xl = 0.3549805 
X2 = 0.0397805 
xl =-0.0572800 
xl = 0.0020825 


f(x*)=0.0000000 
xl = 0.0003630 
xl = -0.0000363 
xl = 0.0003281 
xl = 0.0003280 


8192. 
32767 


f(r)=0.1618187 
xl = -0.0518799 
x^ = 0.0360107 
xl = -0.1236572 
xl = -0.0137939 


f(x*)=0.0000000 
xl = 0.0000816 
X* = -0.0000082 
xl = 0.0002766 
xl = 0.0002766 


f(x*)=0.0711034 
xl =-0.1427002 
x^ = 0.0269776 
xl =-0.0273280 
xl = 0.0599155 


f(.x*)=0.0000000 
xl = -0.0001949 
xl = 0.0000195 
xl = -0.0000995 
xl = -0.0000995 


65535 


f(.T*)=0.0625249 
xl = 0.2141266 
xl = -0.0077057 
xl = 0.0576630 
xl = 0.1507721 


f(x*)=0.0000000 
xl = 0.0000578 
xl = -0.0000058 
xl = -0.0002014 
xl = -0.0002014 


f(.T*)=0.0336186 
xl =-0.0893707 
xl = -0.0030991 
xl = 0.0338045 
xl = 0.0803152 


f(x*)=0.0000000 
xl = 0.0028412 
xl = -0.0002841 
xl = 0.0014357 
xl = 0.0014357 



given .x" = (-2:-2;-3;-3): x* = (0.6295; 0.4334;-1.3062; 1.6882); f(x*)=5.9277; 
given x° = ( 0; 0; 0; 0): x* = (1.0000; 1.0000; 1.0000; 1.0000); f(x*)=6.2146 • 10"^. 

One can conclude, that in system MATLAB 6 the problem cannot be solved, as there is dependence of 
the results on the initial conditions of the search (which is typical for the local methods of optimisation). 

Function No. 5. (-3 < xi < 1, -1 < X2 < 3): 

Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 

following results: 

given x° = (-3;-3): x* = (-3.1219; -3.1219); f(x*)= 17.6169; 
given x° = (-1;-1): x* = (-1.0408; -1.0408); f(x*)= 0.1798; 
given 5° = ( 0.5; -0.5): x* = (-0.3469; 0.3469); f(x*)= -1.7578; 
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Table 3.4 
Wood's Function 



Number of 
points N 


LP-search 
Method 


LP-search Method 
with specification 

(£ = 10-^') 


Halton's 
Method 


Halton's Method 
with specification 

(e=10-«) 


2000 


f(x*) =2. 6487434 
.X* = 0.8862305 
X* = 0.7163086 
= 1.3051758 
xl = 1.5981445 


f(x*)=0.0000000 
xl = 1.0000000 
X* = 1.0000000 
x*3 = 1.0000000 
xl = 1.0000000 


f(x*)=3.3474517 
xl = 1.1176758 
x*2 = 1.3525377 
= 0.8851200 
xl = 0.6272387 


f(x*)=0.0000000 
xl = 1.0000000 
x^ = 1.0000000 
x| = 1.0000000 
xl = 1.0000000 


8192 


f (.**)= 1.7646029 
xl = 0.09338379 
x^ = 0.0186768 
.x5 = 1.4117432 
xl = 1.9288330 


f(.x*)=0.0000000 
xl = 1.0000000 
x^ = 1.0000000 
x*^ = 1.0000000 
xl = 1.0000000 


f(.T*)=0.8959908 
xl = 0.8909912 
x| = 0.7892090 
.xj = 1.0955520 
xl = 1.1084667 


f(.T*)=0. 0000000 
xl = 1.0000000 
x^ = 1.0000000 
x*^ = 1.0000000 
xl = 1.0000000 


32767 


f(x*)=1.4175885 
xl = 1.1044006 
x*2 = 1.1336975 
xl = 0.9775085 
xl = 1.0236511 


f(i*)=0.0000000 
xl = 1.0000000 
x*2 = 1.0000000 
x^ = 1.0000000 
xl = 1.0000000 


f(x*)=0.8959908 
xl = 0.8909912 
x^ = 0.7892090 
= 1.0955520 
xl = 1.1084667 


f(i*)=0.0000000 
xl = 1.0000000 
x^ = 1.0000000 
x^ = 1.0000000 

xl = 1.0000000 


65535 


f(r)=0.1698878 
a:^ = 0.7766876 
X* = 0.6017303 
X* = 1.1534271 
xl = 1.3391876 


f(x*)=0.0000000 
xl = 1.0000000 
xl = 1.0000000 
X* = 1.0000000 
xl = 1.0000000 


f(5*)=0.8959908 
a:^ = 0.8909912 
X* = 0.7892090 
x*3 = 1.0955520 
xl = 1.1084667 


f(5*)=0.0000000 
xl = 1.0000000 
X* = 1.0000000 
x^ = 1.0000000 
xl = 1.0000000 



Table 3.5 
Function No. 5 



Number of 
points N 


LP-search 
Method 


LP-search Method 
with specification 

(£ = 10^6-) 


Halton's 
Method 


Halton's Method 

with specification 
(e=10-6) 


2000 


f(5*)=-2.000000 

xl^ 0.000000 
x^ = 0.000000 


f(x*)=-2.000000 
xl = 0.000000 
xi, = 0.000000 


f(5*)=-1.817494 

xl =-0.363281 
xl =-0.010517 


f(S*)=-1.878901 

xl = -0.346924 
xl = -0.000000 


8192 


f(x*)=-2.000000 

xl = 0.000000 
X* = 0.000000 


f(S*)=-2.000000 
xl = 0.000000 
x^ = 0.000000 


f (5*) =-1.860544 
xl = 0.008789 
xl =-0.340954 


f(x*)=-1.878901 

xl = -0.000000 
xl = -0.346924 


32767 


f(.T*) =-2. 000000 
xl = 0.000000 
x^ = 0.000000 


f(5*)=-2.000000 
xl = 0.000000 
xl = 0.000000 


f(.T*)=-1.963421 
xl =-0.012817 
xl =-0.007807 


f(5*)=-2.000000 
xl = 0.000000 
xl = -0.000000 


65535 


f(x*)=-2.000000 
xl = 0.000000 
x^ = 0.000000 


f(x*)=-2.000000 
xl = 0.000000 
xl = 0.000000 


f(x*)=-1.996424 
xl = 0.004578 
xl = 0.000999 


f(x*)=-2.000000 
xl = -0.000000 
xl = -0.000000 



given x° = ( -0.5; 0.5): x* = (0.3469; -0.3469); i{x*)= -1.7578; 
given x° = (0.2; 0.2): x* = (0.3469; 0.3469); f(x*)= -1.7578; 
given x° = (0.1; 0.1): x* = (0.0000113; 0.0000113); f(.T*)= -2.000000; 
given x° = (0.05; 0.05): x* = (-0.000026; -0.000026); f(x*)= -2.000000; 

One can conclude, that in the MATLAB 6 system the problem cannot be solved, as there is depen- 
dence of the results on the initial conditions of the search (the system finds local minima of the function 
within the vicinity of a given starting point). 

"Himmelblau's function". (2.002 < Xi < 9.998; i = 1,2,. . . ,10): 

Solving the given problem of minimization with the help of the MATLAB 6 system has produced the 
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Table 3.6 
Himmelblau's function 



Amount of 


LP-scarch 


LP-search Method 


Hahon's 


Halton's Method 


points N 


Method 


with 


specification 


Method 


with specification 








(£ = 10 


-6) 




ie= 


10-6) 


2000 


\ } 


=-21.28223 


f(x*)= 


=-45.77846 


f(x*)=-24.99797 


f(x*)=-45. 77846 






6.132746 


xT = 


9.350265 


xl = 9.798881 


xl 


= 9.350265 






6.398238 


X2 


9.350265 


X2 = 9.398390 


X2 


= 9.350265 






8.006809 


x% = 


9.350265 


Xg = 9.184327 


He 


= 9.350265 






8.537793 




9.350265 


X4 = 6.934143 


X^ 


= 9.350265 






9.552910 


xt — 


9.350265 


X5 = 9.139471 


^5 


= 9.350265 




Xo = 
o 


7.897488 


x% = 


9.350265 


xl = 7.850690 


He 

Xg 


= 9.350265 




X^ 


8.537793 


xX = 
7 


9.350265 


X7 = 7.620776 


He 

X'j 


= 9.350265 




Xg 


5.757934 


Xg 


9.350265 


Xg = 8.295979 


xl 


= 9.350265 




X* 


9.131246 


xX = 
9 


9.350265 


x^ = 6.764638 


Xg 


= 9.350265 




X-j^Q 


8.428473 


■^10 


9.350265 


x*g = 7.155517 


^10 


= 9.350265 


65535 


f(.r)= 


=-37.85620 


f(x*) = 


=-45.77846 


f(x*)=-35. 07950 


f(x*)=-45. 77846 






8.814022 


xl = 


9.350265 


xl = 9.319751 


xl 


= 9.350265 




X2 — 


9.325485 


X2 — 


9.350265 


x^ = 8.630329 


X2 


= 9.350265 




■^3 = 


9.040471 


xl = 


9.350265 


x| = 7.693310 




= 9.350265 




X4 = 


8.489965 


x^ = 


9.350265 


x'l = 9.382510 


X4 


= 9.350265 




^5 = 


8.763266 


2^5 = 


9.350265 


xl = 8.223152 




= 9.350265 




^6 = 


7.385049 


^6 = 


9.350265 


X* = 8.532420 




= 9.350265 




Xf^ — 


8.409927 




9.350265 


X* = 7.939859 


Xij 


= 9.350265 




Xg — 


8.878443 


— 


9.350265 


x^ =8.213517 


He 

Xg 


= 9.350265 




Xg — 


9.042423 


Xg = 


9.350265 


x; = 8.880209 


Xg 


= 9.350265 




^10 = 


8.958481 


2^10 — 


9.350265 


xlo = 8.766924 


2^10 


= 9.350265 



following results: 

given x° = (3;3;. . . ;3): the task does not have solutions; 
given x° = (5;5;. . . ;5): 

x* =(7.6458; 9.0869; 9.3527; 9.3878; 9.3332; 9.2646; 9.2418; 9.2781; 9.3716; 9.3649); f(x*)= -42.5434; 
given x° = (8; 3; 4; 5; 6; 7; 3; 5; 6; 7): 

X* =(9.1030; 8.6182; 5.4010; 9.3945: 8.6888; 9.3815; 9.5639; 9.2224; 9.2201; 9.4322); f(r)= -35.1252; 
given x° = (3; 4; 5; 6; 7; 8; 3; 4; 5; 6): the task does not have solutions; 
given x° = (9; 8; 7; 6; 5; 9; 8; 7; 6; 5): 

X* =(9.2172; 9.1307; 9.3271; 9.2110; 9.2809; 4.5076; 9.2679; 9.2796; 8.6958; 8.4667); 
f(x*)= -32.6965. 

Here we conclude, that in the MATLAB 6 system the problem cannot be solved. 

For the test function 7 the solution was found by the method of LP-scarch and by Halton's method 
without the procedure of specification, for N = 65535. The following results were obtained: 
method of LP-search: f(x*) = 27845.37; x* = (1.49955; 6.12384); 

Halton's method: f(.T*) = 27845.02; x* = (1.50398; 6.14608). 
which are in good agreement with the known solution of the given problem. 

The results of the calculations show extremely high efficiency of Halton's and LP-search methods for 
solving a problem of numerical global optimisation of a function of many variables. 

Also, the advantage of the methods is that neither the differentiability of the objective function, nor 
even its analytical definability is required for their application. It is only enough to have an opportunity 
to calculate the values of the function at any arbitrary points in its domain, which provides for a wide 
opportunity of application of the methods and the ability to solve the majority of practical problems. 

At the same time the advantages of gradients methods should not be underestimated, the main one 
being the high speed of convergence to a point of a minimum. It appears to be expedient to use the 
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better qualities of direct and gradient methods and to use them in combination, which can substantially 

reduce the volume of the calculations necessary for the search for the global minimum with a specified 
accuracy. This conclusion is also supported by the results of the numerical experiments presented above. 

4. Final remarks. In summary we shall consider one more problem of numerical optimisation - the 
problems of the large dimensions. It is known [4], that in the case when the dimension n of the argument 
of the objective function becomes very large, application of gradient procedures becomes impossible or 
causes significant technical difficulties. 

If the dimension of the objective function n > 51, it is then possible to take advantage of generalized 
LP^ -sequence calculated with the same formulas as for the case 1 < j < oo. Unfortunately, there are 
no simple-enough formulas for the calculation of the directing points, as was already mentioned above. 
Therefore it is possible to take advantage of the already developed table of numbers Vf for n < 51, 
and use the usual pseudorandom numbers 7 for the missing coordinates of quasi-random points, for 
example, Qi = (q^^, qg, . . . , q|i, 752, 753, • . . , 7^). As various coordinates of points are disparate [11] 
(coordinates with smaller indexes are better distributed), it is useful to assign indexes to the variables of 
the objective function in a way, when the most essential coordinates have smaller indexes, for which q^- 
is calculated, and for all other coordinates - 7^. Such way of calculation can speed up the convergence, 
in comparison with the calculation only by random points 7. 

The second approach to the problem of global optimisation in case of a large dimension of the 
objective function consists of the use of the generalized Halton's sequence {Pi}, i = 1, 2, . . . , the points 
of which have coordinates Pj = (p„(i), Pr2(i)> Pr„(i)r--)> where ri < r2 < ra < . . . < r„ < . . . 
- is a sequence of all prime numbers. For the calculation of the points Pj, in practice, it is possible to 
set a big enough table of prime numbers or to program an algorithm of their finding, for example, the 
Eratosthenes' Sieve method. The method consists of successively deleting all the composite numbers from 
a sequence of natural numbers. For example, let it be required to find all the prime numbers between 1 
and 30. For this purpose one needs to write down all natural numbers from 1 to 30 in ascending order. 
First number is 1 - not a prime number, therefore it is deleted. The following is number 2 - prime, it 
is kept, and every second number after 2, i.e. 4, 6, 8, . . . is deleted. The following prime number 3 is 
kept, and every third number, after 3, is deleted. The following prime number 5 is kept, and every fifth 
number, after 5, is deleted (numbers already deleted are also taken into account) etc. As a result all 
prime numbers, smaller than 30, are obtained (the kept undeleted numbers): 2, 3, 5, 7, 11, 13, 17, 19, 
23, 29. If it is necessary to find all prime numbers not exceeding N than one has to use the procedure 
described above up to the greatest prime number p, not exceeding -x/iV- For example, if it is necessary 
to create a table of prime numbers not exceeding 1000, it is necessary to finish the deletion procedure on 
the number 31 inclusive. There are now printed tables of prime numbers for up to 12 million, i.e. it is 
possible to obtain sequences of Halton's points practically for any dimension. 
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